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Abstract: Learning organizations rely on collaborative information and understanding to support and 
sustain professional growth and development. A collaborative self-assessment instrument can 
provide clear articulation and characterization of the level of adoption of innovation such as the use 
of instructional technologies. Adapted from the "Level of Use" (LoU) and "Stages of Concern" indices, 
the Level of Adoption (LoA) survey was developed to assess changes in understanding of and 
competence with emerging and innovative educational technologies. The LoA survey, while reflecting 
the criteria and framework of the original LoU from which it was derived, utilizes a specifically 
structured on-line, self-reporting scale of "level of adoption" to promote collaborative self-reflection 
and discussion. Growth in knowledge of, and confidence with, specific emergent technologies is 
clearly indicated by the results of this pilot study, thus supporting the use of collaborative reflection 
and assessment to foster personal and systemic professional development. 

Resume: Les organisations apprenantes s'appuient sur des informations et une comprehension 
issues de la collaboration afin de soutenir et d'entretenir la croissance et le perfectionnement 
professionnels. Un instrument d'auto-evaluation collaborate permet d'articuler et de caracteriser de 
maniere explicite le niveau d'adoption des innovations, comme ^utilisation de technologies 
educatives, par exemple. Adapte a partir des indices de « niveau d'utilisation » (ou « LoU » pour Level 
of Use) et de « niveaux de preoccupation », I'instrument d'enquete sur le niveau d'adoption (ou 
« LoA » pour Level of Adoption) a ete conpu afin d'evaluer les changements qui surviennent dans la 
comprehension des technologies educatives emergentes et innovatrices ainsi que dans les 
competences relatives a ces technologies. L'instrument d'enquete LoA, bien qu'il reflete les criteres 
et le cadre de I'indice original LoU dont il est derive, utilise une echelle d'autodeclaration en ligne du 
« niveau d'adoption » qui est structuree specifiquement afin de promouvoir I'autoreflexion et les 
discussions collaboratives. Les resultats de cette etude pilote demontrent clairement une croissance 
des connaissances et de la confiance relatives a certaines technologies emergentes en particulier, ce 
qui vient du meme coup appuyer I'utilisation de la reflexion et de revaluation collaboratives afin de 
favoriser le perfectionnement personnel et professionnel systemique. 


Background 


David Garvin (1993) proposed that a learning organization is "skilled at ... modifying its 
behaviour to reflect new knowledge and insights" (p. 80). One component of developing this 
skill, Tom Guskey (2005) suggests, is the ability to use data and information to inform change 
initiatives. Educators within learning organizations, it can be further argued, routinely engage in 
purposeful conversations about learners and learning (Lipton & Wellman, 2007). How might 
these information-based conversations be promoted and supported within a variety of 
educational environments? Of particular interest to us is the adoption of innovative 
instructional technologies to enhance learning, and the use of technology to encourage 
collaborative conversations regarding this adoption. As society moves into the 21 st century, 
educators at all levels are proactively adopting new teaching methodologies and technologies 
(Davies, Lavin & Korte, 2008) to help students gain an understanding of material taught. Useful 
collaborative information regarding the adoption of instructional innovations must be actively 
cultivated (Steele & Boudett, 2008), and is arguably most powerful when the educators 
concerned have ownership of the inquiry process themselves (Reason & Reason, 2007). 

The "Level of Use of an Innovation" (LoU) and "Stages of Concern" (SoC) assessments, 
identified by Hall, Loucks, Rutherford and Newlove (1975), as key components of the Concerns- 
Based Adoption Model (CBAM) can provide an articulation and characterization of the stages of 
adoption of an educational innovation. The LoU has been identified as "a valuable diagnostic 
tool for planning and facilitating the change process" (Hall & Hord, 1987, p. 81) and is intended 
to describe the actual behaviours of adopters rather than affective attributes (Hall, et al., 1975). 
We have used the concepts and components of the LoU and SoC to develop a collaborative 
data-gathering instrument to inform professional understanding and discussions regarding the 
adoption of technological innovations for learning, and have identified our instrument as the 
"Level of Adoption" (LoA) survey. 

The thoughtful use of the LoU and SoC by a "professional learning community" (Dufour & 
Eaker, 1998) or a "community of professional practice" (Wenger, 1998) may allow members of 
such a community to self-assess their process and progress toward adoption of an innovation 
and to identify critical decision points throughout the process. Increasingly, these types of 
communities focus on continuous evolution of professional inquiry (Garrison & Vaughn, 2008) 
to address the enhancement of teaching and learning in blended and online environments. An 
adaptation of the LoU was previously used by one of the authors while working with teachers in 
a school jurisdiction to allow members of that professional community to self-assess personal 
and systemic professional change during the course of a staff development program focused on 
the adoption of specific innovative educational practices. Components of the LoU and SoC 
indices have been adapted by various researchers to assess and facilitate personal, collective, 
and systemic professional growth during planned processes of implementation and adoption of 
educational technology innovations (Adey, 1995; Bailey & Palsha, 1992; Gershner, Snider & 
Sharia, 2001; Griswold, 1993; Newhouse, 2001 ). In this study, we were interested in piloting a 



"Level of Adoption" (LoA) survey to collaboratively inform professional educators regarding their 
adoption of innovations in educational technology. 

During "summer-session" (May-August) 2007 we taught a blended-delivery graduate level 
education course at the University of Lethbridge (Alberta, Canada) titled "Using Emergent 
Technologies to Support School Improvement." During May and June students accessed 
readings, assignments, and instruction online via the university's learning management system 
(LMS). For two weeks in July the class convened in an intensive daily three-hour on-campus 
format. Following this, course activities continued online via the LMS. The students in this 
course were seasoned classroom teachers and school administrators who brought to the course 
a range of experience and expertise with educational technologies. The class wished to 
ascertain (a) what levels of experience, expertise, and confidence with various technologies 
they were bringing to the course, and (b) if this experience, expertise, and confidence changed 
as a result of course participation. To that end, a LoA survey was developed and administered to 
the class via the LMS survey function. 

Design and Data Collection 

While a focused interview format is traditionally used to collect LoU data (Gershner, Snider & 
Sharia, 2001;Hord, Rutherford, Huling-Austin & Hall, 1987; ), our adaptation utilized a 
specifically structured self-reporting scale of "level of adoption" to allow participants to self- 
reflect through the reporting process. The original "Level of Use" matrix (Hall, et al., 1975) 
identifies eight levels or stages of adoption of an innovation: "non-use", "orientation", 
"preparation", "mechanical use", "routine", "refinement", "integration", and "renewal" (p. 84). 
Each of these levels of adoption is further defined in the terms of the attributes or actions of 
participants regarding "knowledge", "acquiring information', "sharing", "assessing", "planning", 
"status reporting", and "performing" as indicated by Table 1. This complex of descriptors from 
the original CBAM/LoU (Hall, et al, 1975) was not used directly in our application as an 
assessment of level of adoption of educational technologies, but was utilized to frame precise 
stem structures and level descriptors related to the specific educational technologies of interest. 



Table 1. Level of Use Matrix (Hall, et al, 1975, pp. 89-91) 
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As the attribution of level of adoption is self-reported, attention was paid to the design of the 
LoA for this purpose and in this format in order to be able to address issues of content validity 
(Neuman, 1997). The validity of the LoA survey, we believe, depends primarily on the skill and 
care applied to framing accurate and focused descriptors. In this instance, it was critical to 
ensure that the self-reporting scale devised was as specific as possible and accurately described 
the kinds of behaviours and changes in professional knowledge and praxis which the 
participants wished to assess. The response choices were worded identically for each stem 
related to specific technologies being investigated. 


Further, it was deemed important to use identical "radio buttons" or "check boxes" to 
identify individual choices rather than numbers (0, 1, 2, 3, etc.) on the forms used to assess level 
of adoption, so that no implied value was associated with a specific response (see Figure 1). The 
"levels" of the LoA in this application should not imply a hierarchical progression, but rather a 
nominal description of the state of the community's adoption of an innovation. 


0 1 really don't know anything about this technology, or am not sure that it 

would be useful for my classes 

0 1 have some information about this technology, and am considering 

whether it might be useful for my classes 

0 1 now know enough about this technology that I am preparing to use it 

for my classes 

0 1 am using this technology now and am primarily focused on learning the 

skills necessary to use it properly and effectively for my classes 

0 1 use this technology routinely without much conscious thought, and my 

use of this technology is fairly routine for my classes 

0 1 use this technology regularly, and am implementing ways of varying its 

use to improve the outcomes derived for my classes 





0 


I am collaborating with colleagues to develop ways in which we can use 
this technology to better meet our common objectives for our classes 
I still use this technology, but am exploring other technologies to replace 
it that will better meet the objectives for my classes 

Figure 1. Level of adoption descriptors: adapted by D. Orr, from Hord, et al. (1987) 

Though nominal in nature as described above, the results were considered (for purposes of 
analysis) in an ordinal fashion - indicating degrees of adoption. It is our contention that, as this 
use of the LoA is intended to collaboratively inform professional praxis and development, the 
instrument may be administered subsequently to the same participants in an identical form 
throughout the process of a professional development program (in this instance a graduate 
course in educational technology) to assess efficacy of the program and to provide a self- 
reflective "mirror" for participants engaged in their own professional development. 

The LoA, we posit, can be used to collect information over time, sampling a population at 
various points throughout the implementation of an innovative practice - one of the strengths 
of this type of tool. If the descriptor stems and responses are framed carefully and 
appropriately, the same survey can be repeated at various times during a project and the results 
can reasonably be expected to provide useful longitudinal information regarding change in 
professional understanding and practice. 

In our construct, where the intention is to facilitate collaborative decision-making, 
professional growth, and personal reflection, the LoA survey asks participants to self-identify 
their own degrees of adoption of various educational technologies. Respondents selected a 
"level of adoption" descriptive of their perceived degree of knowledge, utilization, confidence, 
or competence; ranging from "non-use" through "orientation", "preparation", "mechanical use", 
"routine", "refinement", and "integration", to "renewal"; consistent with the eight levels of 
adoption of an innovation defined by the "Level of Use" index (Hall & Hord, 1987; Hall, et al, 
1975; Hord, et al, 1987). Respondents in this pilot study self-identified their level of adoption of 
twenty common educational/instructional technologies: web browsers, word processing 
software, spreadsheet software, mind-mapping software, e-mail/web-mail, presentation 
software, video-playback software, video production software, web site development software, 
image processing software, database software, videoconferencing, learning/content 
management systems, interactive whiteboards, interactive conferencing/bridging software, 
digital still cameras, digital video cameras, document scanners, scientific/graphing calculators, 
and laboratory probeware/interface systems. 

Results 

For this pilot study, a class cohort of 26 graduate students was surveyed concerning their 
level of adoption of various educational technologies twice during the course and again four 
months after the conclusion of the course. Students responded to three identical, 20-item, LoA 
surveys via the class online learning management system - the "pretest" survey in June prior to 




the students' arrival on campus, the "posttest" survey in August at the conclusion of the on- 
campus course component, and the "post-posttest" survey in December of the same year. 
Twenty-five students (96%) responded to the "pre-test" survey, twenty-two (84%) responded to 
the "post-test" level-of-use survey, and seventeen (65%) responded to the post-posttest survey. 
Twenty-one students (81%) responded to both the pre-test and posttest surveys, while fifteen 
(58%) responded to all three (pre-, post-, and post-post-) surveys. Comparison of these three 
data sets reflects changes in self-reported knowledge and utilization of, and confidence and 
competence with, emergent educational technologies. 

To reflect the possible potential for the use of this instrument as an indicator of change in 
praxis during and following a professional development program, we chose to restrict our 
analysis of results to the responses from the fifteen participants who completed all three 
administrations of the instrument. Due to the relatively small size of this data sample, we 
avoided rigorous statistical investigation of the data (restricting measures of significance to Chi 2 
only) and focused on inferences we believe can reasonably be drawn from descriptive analyses 
in the context of professional development and change in professional praxis. Results (see 
Appendix - Table 2) indicate self-reported increase of use for all 20 technology categories, and 
an increased "average level of use" (average of category means). 

Peripheral technologies, which were commonly used by students and instructors during 
the course but not directly addressed by the instructional activities (such as web browsers, word 
processing, spreadsheet applications, and e-mail) never-the-less revealed increased reported 
levels of use over the three administrations of the survey. The results for the use of 
"presentation software" (such as PowerPoint and Keynote) are worth noting. The use of this 
technology was not directly taught to students, but was consistently modeled by instructors 
throughout the on-campus course component. Results (Figure 2) indicate a noticeable change 
from self-reported relatively low levels of adoption to considerably higher levels. The mean and 
median values increased from 4.40 to 5.93 and 4.00 to 6.00 respectively between the pretest 
and post-posttest administrations. And, interestingly, a number of students selected this 
technology as a topic and/or medium for their major course project. 




Figure 2. Reported levels of adoption of presentation software (n=15) 

Of greatest interest to us were the results for videoconferencing, learning management 
system, interactive whiteboard, and conferencing/bridging technologies; as these topics were 
the foci of specific teaching-learning activities in the on-campus course component. The pretest 
results regarding, for example, videoconferencing (Figure 3) indicated that thirteen of fifteen 
respondents either had little or no knowledge regarding or were merely "considering" the 
usefulness of educational videoconferencing; while the other two respondents reported 
themselves to be "preparing" and "focusing on learning skills necessary" to use 
videoconferencing technologies respectively (mean=2.00, median=2.00). 



Survey 

PreTest 

PostTest 

D Post-PostTest 


Level 1 Level 2 Level 3 Level 4 Level 5 Level 6 Level 7 


Figure 3. Reported levels of adoption of videoconferencing (n=15) 


By the conclusion of the course in August there was an obvious, and not unexpected, 
increase in reported level of use (mean=3.00, median=3.00). It is important to note the 
significant (p<0.005) increase in reported level of use as these students (practicing educational 
professionals) returned to the workplace and had the opportunity to access and apply these 
technologies within their schools (mean=4.53, median=5.00). Nine respondents reported their 
level of use as "routine" or higher on the post-posttest. 

Similar findings regarding continuing professional growth and positive change in praxis 
were reported for learning management system, interactive whiteboard, and 
bridging/conferencing technologies. A comprehensive learning management system (LMS) was 
used to deliver, complement, and supplement instruction for these graduate students 
throughout both the off-campus and on-campus components of the course. The students were 
expected to use this LMS to engage in collaborative discussions, to access assignments and 
readings, and to post written assignments. One topic specifically covered during the on-campus 
course component was the application of learning management systems in K-12 classrooms. As 
with videoconferencing, results indicated a noteworthy change in reported use of this 
technology over the course of this study (Figure 4). Initially 13 of 15 respondents reported 
themselves to be at level one ("non-use") or two ("orientation"), with the highest level of use 
(one respondent) reported merely as "mechanical use" (mean=2.80, median=3.00). By 
December (following the conclusion of the course and return to the workplace) eight 
respondents indicated LMS levels ranging from "routine," to "refinement," to "integration" 
(mean= 4.93, median=5.00). 



Survey 

PreTest 

PostTest 

Post-PostTest 


Figure 4. Reported levels of adoption of learning management systems (n=15) 

The changes in level of adoption reported for interactive whiteboard technologies (Figure 5) 
were of considerable interest as this technology is being introduced into many schools in our 
region. During the on-campus class we specifically instructed students about the classroom use 


of this technology and its application supporting instruction delivered via videoconference. It is 
worth noting reported levels of adoption regarding "orientation" and "preparation" between 
the August survey (administered at the end of the class) and the December survey 
(administered after these practitioners had returned to their school districts). This result 
provokes further questions concerning participants' perceptions of the "potential" use of a 
technology (perhaps surfaced during the class?) and their "actual" use of the technology once 
back in the schools. Of note, never-the-less is the increase in the number of respondents 
reporting themselves as engaging in collaborative adoption at the "integration" level for both 
interactive whiteboard and LMS technologies. 



Figure 5. Reported levels of adoption of interactive whiteboard technologies (n=15) 

The significant (p<0.001) result for the reported use of bridging/conferencing software 
(Figure 6), possibly reflects the introduction of a technology with which these educators had 
little or no previous experience. Of note was the number of respondents (four) reporting 
"preparation" for use, and the three respondents reporting either "mechanical" or "routine" 
use of this technology on the December post-posttest survey, and the concomitant increase in 
the mean reported level of use from 1.00 to 2.60. The National Staff Development Council 
(2003) identifies collaborative practice within learning communities as a vital component of 
authentic and efficacious professional growth and change. Of particular interest, in terms of the 
development of communities of professional practice is the move from "skill development" and 
"mechanical" levels of use to "refinement" and "collaborative integration" which is reflected in 
these results. 



Figure 6. Reported levels of adoption of bridging/conferencing software (n=15) 

Discussion and Conclusion 

Questions concerning the accuracy of data are always of concern. Clearly the number of 
participants involved in this administration of the self-reported level of adoption survey limits 
the ability to establish effect-size changes, or to explore questions of reliability. Never-the-less, it 
is worth considering, within the context of a community of professional practice, strategies for 
promoting the validity and reliability of responses in order to corroborate the potential of this 
type of information-gathering to support collaborative professional development initiatives. 

We posit that it is firstly critical to create a supportive, collaborative, and intellectually and 
emotionally secure professional community of learners, before asking participants to use a self- 
reporting, self reflective tool such as the LoA to inform progress of and decisions about their 
professional growth and development. It is crucial that respondents know (a) that responses are 
anonymous (on-line survey tools facilitate this, but other "blind" techniques work as well), and 
(b) that it is "OK" to be at whatever level one is at. It is critical as well to stress with respondents 
that this tool is used to inform programs and processes, not to evaluate people. Thus, "non- 
users" of particular technologies should be empowered to voice disinterest in or lack of 
knowledge about, a program by indicating a low level of use. 

Similarly, there should be no perceived "status" attached to users who report themselves to 
be at refinement, integration or renewal levels of use. This reinforces the importance of writing 
clear, well-articulated, appropriate, non-judgmental, and non-evaluative stems and responses. 
No less importantly, one could and should collect related "innovation configurations" (Hall & 
Hord, 1987; Newhouse, 2001); such as teacher artifacts, login summaries, participation counts, 
attitude surveys, participant surveys, and classroom observations with which to corroborate and 
elucidate the LoA results for the community. It is critical throughout the process to maintain 


complete transparency in the collection and dissemination of results. Where a professional 
development program or innovation adoption is cooperatively and collaboratively initiated, 
planned, and implemented, the participants will ideally wish to respond to the LoA as honestly 
as possible in order to accurately assess a program or innovation adoption process over which 
they have ownership as members of a community of professional practice with a shared vision 
of professional growth and change (Dufour & Eaker, 1998). Sharing results of the LoA survey 
with participants encourages ownership of both the information and the process (Reason & 
Reason, 2007), as an impetus to faculty engagement with the adoption of innovation (Waddell & 
Lee, 2008). In our further applications of this instrument, we are implementing on-line survey 
software which reports aggregate results to all participants in real-time as responses to the LoA 
survey accrue. 

We believe the results from this pilot project indicate positive professional growth in 
respondents' knowledge and utilization of, as well as confidence and competence with, 
emergent educational technologies. Where addressed by the course content, growth in 
knowledge of and confidence with emergent technologies, as defined by the survey criteria, is 
clearly indicated by the results of this level of adoption survey. We are primarily interested in 
the process of the development of the "Level of Adoption of an Innovation" survey as a self- 
reporting, self-reflective professional tool; and how the information derived from the results can 
be used to facilitate planning for and implementation of innovative changes within a 
professional community of learners. We are currently implementing similar adaptations of the 
LoA survey within other communities of professional practice, and investigating ways in which 
adaptations for specific purposes can be derived from the original work of Hall, et al. (1975) and 
Hord, et al. (1987) and generalized through the LoA to various communities of professional 
practice. 

The LoA survey used in this study, focusing on the adoption of instructional technologies, is 
being further adapted and applied to inform and support the collaborative professional 
development of university faculty members, with a revised catalogue of emergent and 21 st 
century technologies relevant to post-secondary instruction. The updated catalogue of 
technologies includes social networking, simulations and video-gaming, video-streaming, 
podcasting and vodcasting, and assistive technologies. Additionally, an on-line version of this 
up-dated LoA survey, including real-time aggregate reporting to participants, is being used to 
inform environmental, wildlife and outdoor educators across Canada and internationally 
regarding their adoption of innovative technologies to support instructional practices. Guskey 
(2005) identifies the importance of providing data to "improve the quality of professional 
learning ... activities" (p. 16). A critical challenge as we implement these new applications have 
been articulating concise descriptive statements accurately reflecting the matrix of adoption of 
innovation (Hall, et al, 1975), while addressing the unique requirements of specific collaborative 
professional development initiatives and unique communities of practice and inquiry. 



Potential and Challenges for Further Application 

It is intended that a professional community should access this instrument on an on-going 
basis at critical points in a systemic decision-making process to collaboratively assess changes in 
praxis regarding adoption of technologies for instruction. The on-line, reporting program we 
recently adopted provides real-time, aggregate comparative information (Figure 7), which can 
both document and inform a collaborative professional development initiative. 


Your Responses : 

your own responses regarding your level of adoption of 
each the twenty-four technologies identified 
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Average Group Responses : 

the average summary level of adoption of each the 
twenty-four technologies identified for all of the 
respondents. 
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Figure 7. Online, real-time, aggregrate response reporting 


The feedback from members of other communities which are using this instrument regarding 
their perceptions of its efficacy, our own analysis of the responses, and our continuing 
discussions regarding emergent technologies that potentially address the teaching and learning 
needs of the 21 st century are informing on-going iterations of this self-reflective collaborative 
assessment tool. 

Comments from participating respondents have provided significant information as we are 
continually revising and refining the instrument. The most common comment identified the 
desire to be able to indicate that one may be very familiar with a specific technology and 
consciously chose not to use it for instructional purposes. 

There's no option for "I know quite a bit about this tool and choose not to use it", which is the 

case for several of the technological tools. 

Another respondent identified the need to indicate the adoption of new technologies which 
have completely replaced "older" ones which are still identified on our list. These comments 
have validated and enhanced our on-going discussions about the necessity of both expanding 
our adoption model and reconceptualizing it in a more cyclic fashion to account for the ever- 


and rapidly-evolving nature of "emergent" technologies. One significant comment, worthy of 
note, responds to the instrument's inherent presumption of the value of adoption of specific 
technologies. 

Technologies have both positive and negative implications for curriculum, pedagogy and 
'learning' that cannot be accounted for, here, in the way this instrument already 'determines' 
according to different levels of adoption. Where, for instance, can I state that often I do not 
adopt technologies because I fundamentally believe there are numerous negatives and 
problems associated with them? 

We would contend that this comment speaks well to the intended use of this instrument, the 
importance of ensuring that its application is linked to and focus derived from an adoption 
initiative collaboratively designed and shared by a community of professional practice, and the 
importance of adequate communication of the genesis, purpose, focus, dissemination and 
application of the survey results. While our investigations have focused on the adoption of 
technologies for instruction, the CBAM and LOU (Hall & Hord, 1987; Hall et a I, 1975; Hord, et al, 
1987) from which our self-assessment level-of-adoption paradigm has been derived, is intended 
to assess and inform the adoption of any collaboratively identified and validated educational 
innovation. To be successful, however, the community itself needs to have ownership of the not 
only the data collected, but the data collection design and process. The collaborative 
development and application of the LoA should capitalize on "data as an impetus to examine 
practice and dialogue as a means of engaging ... faculty" (Waddell & Lee, 2008, p. 19). It is our 
intent that the members of a community of practice and inquiry initiating an adoption initiative 
would use the LoA framework to develop a unique instrument which addresses their unique 
needs and informs their unique innovation initiative. 

Other comments from respondents, which have addressed everything from the specific 
technologies identified to the nature and wording of the level descriptors, provide a richly 
informative critique of the LoA conceptualization and paradigm. As we proceed with the on- 
going development and refinement of this instrument to serve the collaborative needs of 
various different communities of professional practice, this information is providing a baseline 
from which to continually re-examine and re-create the LoA to better meet the needs of these 
individual communities. Guskey (2005) identifies the importance of providing data to "improve 
the quality of professional learning ... activities" (p. 16). A critical challenge as we approach 
these new iterations is articulating concise descriptive statements accurately reflecting the 
matrix of adoption of innovation (Hall, et al, 1975), while addressing the unique requirements of 
each community of professional practice and their specific collaborative professional 
development initiatives, and authentically representing appropriate emergent 21 st century 
educational technologies. 

To that end, for our most current project involving school district and school site instructional 
technology leaders from across the province of Alberta, we have significantly revised our 



original eight-level matrix to include two additional levels of adoption (Figure 8). 


0 

1 don't have enough information about this technology to assess whether or not it 
would be useful in my teaching 

0 

1 am familiar with this technology but do not think that it would be useful in my 
teaching 

0 

1 have enough information about this technology to consider whether or not it might 
be useful in my teaching 

0 

1 am preparing to use this technology in my teaching 

0 

1 am using this technology now in my teaching and 1 am primarily focused on learning 
the skills necessary to use it properly and effectively 

0 

1 use this technology regularly in my teaching and my use of this technology is fairly 
routine 

0 

1 use this technology regularly in my teaching and 1 am implementing ways of varying 
its use to improve the outcomes derived from it 

0 

1 am collaborating with colleagues to develop ways in which we can use this 
technology to better meet common instructional objectives in our teaching 

0 

1 still use this technology in my teaching but 1 am exploring other technologies to 
replace it that may better meet my objectives for my teaching 

0 

1 no longer use this technology in my teaching and have replaced its use with other 
technologies which better meet my objectives for my teaching 


Figure 8. Revised LoA Descriptors: adapted by D. Orr, from Hord, et al (1987) 

Based on the original LOU level descriptors (Hall, et al, 1975), we posit that the first two 
levels both actually represent the original "non-use" level, as regardless of the reason for non- 
use the respondent would still be indicating "non-adoption" of a collaboratively chosen 
innovation. 

As we are beginning to consider, due to the evolutionary nature of educational technologies 
and their adoption, a more cyclical view of the innovation adoption process; we suggest that a 
respondent who would report our new level 10 ("I no longer use ...") for a particular technology 
would by corollary also report level 4, 5, or 6 for the "other technologies" which have been 
adopted in place. This assumption requires further investigation. Never-the-less, based on the 
original LoU matrix (Hall, et al, 1975, pp. 54-55), we propose that responses at Level 5 are 
clearly cuspidal - representing adoption of innovation and established changes in praxis to 
support learning outcomes. 

Additionally we are continually culling, refining, redefining and clustering our list of 
technologies in an attempt to better represent current and continually evolving examples of 
emergent yet applicable technologies for instruction (Figure 9), recognizing that any such "list" 
of technologies is constantly evolving in the face of technological innovation and convergence. 
We have thus created the single category of "classroom video" to include any form of video 
used in the classroom regardless of mode of delivery or format (i.e., dvd, streaming, embedding. 





etc). We have certainly had to add "mobile devices" to our list. It seemed important to identify 
"wikis and blogging" and "social networking" as different categories since they are increasingly 
being used to meet different educational needs. We have identified "virtual worlds" as a 
singular category as this application can take on numerous different roles in education; though 
it may include and overlap other categories (such as "gaming and simulations"). 


Presentation Software 

Classroom Video 

Concept-Mapping Software 

Interactive Whiteboard Technology 

Interactive Classroom Response System 

Visual Image Capturing Technologies a 

Visual Imaging Technologies 

Video Production Software 

Mobile Devices 

Learning/Content Management Systems 

Podcasting 

Website Development 

Wiki / Blogging 

Social Networking 

Virtual Worlds 

Gaming / Simulations 

Large Group Video-Conferencing Technologies 

Interactive Desktop Web-Conferencing / Bridging Technology 


Figure 9. Revised list of technologies for teaching 

Dealing with the evolving overlapping of functionalities through convergence will continue to 
present difficulties as information/communication technologies and web 2. 0/3. 0/4.0 
applications continually and organically evolve, and concomitant 21 st century skills (Crookson, 
2009) continue to be posited and debated. Additionally we have removed production and 
laboratory software (such as word processing, data management, probeware) as these seem 
increasingly to be standard communication, information or research tools rather than 
educational technologies-though this interpretation is certainly open to argument. Our LoA 
application currently in progress (involving school district and school site instructional 
technology leaders from across the province of Alberta) makes use of this list of technologies, 
the revised ten-point scale and the online real-time reporting mechanism. We have collected 



the pre- and posttest data from this group, and are preparing to administer the post-posttest 
survey for them to inform their sustainable adoption of emergent technologies for instruction. 

The on-going organic and evolutionary nature of the LoA itself as an online, self reporting, 
self reflective, collaborative tool is intended to support any of a variety of very different 
professional communities in assessing their adoption of educational initiatives to support 21 st 
century learners and enhance teaching and learning. The use of online, real-time data 
collection, aggregation, and reporting is the critical component, we argue, for providing new 
and different forms of collaboration to enable the development of collaborative links among 
educators (NSDC, 2003), usefully disseminating information regarding the adoption of 
instructional innovations (Steele & Boudett, 2008), and providing the educators concerned with 
ownership of the inquiry process themselves (Reason & Reason, 2007). We suggest that while 
the content of the LoA should be context-specific, the over-arching construct and process of its 
application is critical to its value as an instrument to facilitate data-informed decision-making. 
Rather than employment as a one-time administrative tool to merely aggregate systemic 
metrics, it is designed and intended to be deployed by, within and for a collaborative community 
of professional practice repeatedly over time to inform and facilitate their collective decisions 
and strategies regarding the adoption of innovative practices to enhance teaching and learning. 

Effective and sustainable implementation of instructional change requires that communities 
of inquiry and professional practice must be empowered to continually "reexamine and reflect 
on their course curriculum, teaching practice, and use of information and communication 
technologies" (Garrison & Vaughn, 2008, p. 53). We posit that critical changes in teaching 
practice are most likely to meet with success only when the professional educators themselves 
responsible for the implementation of educational change have ownership of both the 
professional development activities which support the adoption and sustainability of change 
and the information which informs and directs these activities. 

Appendix 

Table 2. LoA Results - Mean, Median, and Standard Deviation by Technology (n=15) 



PreTest 

PostTest 

Post-PostTest 

Topic 

Mean 

Median 

SD 

Mean 

Median 

SD 

Mean 

Median 

SD 

Web Browsers 

4.53 

5.00 

1.407 

5.80 

6.00 

0.561 

5.80 

6.00 

0.775 

Word Processing 

5.67 

5.00 

1.000 

6.07 

6.00 

0.258 

6.47 

6.00 

0.834 

Spreadsheet 










Applications 

3.73 

4.00 

1.223 

3.47 

4.00 

0.990 

4.40 

5.00 

1.404 

Mind-Mapping 










Software 

2.60 

2.00 

2.131 

3.40 

3.00 

2.165 

3.14 

3.00 

1.956 

E-Mail 

5.47 

5.00 

0.640 

6.33 

6.00 

1.113 

6.07 

6.00 

1.163 

Presentation 

4.40 

4.00 

1.639 

5.73 

6.00 

1.280 

5.93 

6.00 

1.387 




Software 
Video Playback 

3.27 

4.00 

1.335 

4.40 

4.00 

1.682 

4.80 

5.00 

1.656 

Video Production 

1.67 

1.00 

0.976 

2.87 

3.00 

1.356 

2.73 

2.00 

1.580 

Website 

Development 

1.47 

1.00 

0.640 

2.33 

2.00 

1.113 

2.20 

2.00 

1.207 

Image Processing 
Software 

2.40 

2.00 

1.056 

2.87 

3.00 

1.302 

2.53 

2.00 

1.060 

Database Programs 

1.53 

1.00 

1.060 

2.13 

2.00 

0.990 

2.27 

2.00 

1.792 

Videoconferencing 

2.00 

2.00 

0.756 

3.00 

3.00 

1.363 

4.53 

5.00 

1.727 

Learning 

Management Systems 

2.80 

3.00 

1.146 

3.93 

4.00 

1.033 

4.93 

5.00 

1.624 

Interactive 

Whiteboards 

2.87 

3.00 

1.727 

3.60 

3.00 

1.352 

3.80 

3.00 

1.971 

Bridging/Conferencin 
g Software 

1.00 

1.00 

0.000 

2.27 

2.00 

0.704 

2.60 

2.00 

1.121 

Digital Still Cameras 

4.13 

4.00 

1.407 

4.93 

5.00 

0.961 

4.93 

5.00 

1.438 

Digital Video Cameras 

4.13 

4.00 

1.407 

3.60 

4.00 

1.502 

3.67 

3.00 

1.877 

Document Scanners 

3.80 

4.00 

1.424 

4.13 

4.00 

1.407 

4.93 

5.00 

1.685 

Scientific Calculators 

1.67 

1.00 

1.113 

2.33 

2.00 

1.447 

2.08 

1.00 

1.553 

Laboratory 

Probeware 

1.13 

1.00 

0.516 

1.33 

1.00 

0.816 

1.27 

1.00 

0.594 

Average Level of Use 
Index 

3.01 

2.95 

0.428 

3.73 

3.70 

0.570 

3.97 

3.75 

0.753 
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